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Abstract — It is shown that any communication system which 
admits a sum-product (SP) receiver also admits a corresponding 
hnear-programming (LP) receiver. The two receivers have a rela- 
tionship defined by the local structure of the underlying graphical 
model, and are inhibited by the same phenomenon, which we 
call pseudoconfigurations. This concept is a generalization of 
the concept of pseudocodewords for linear codes. It is proved 
that the LP receiver has the 'optimum certificate' property, and 
that the receiver output is the lowest cost pseudoconfiguration. 
Equivalence of graph-cover pseudoconfigurations and linear- 
programming pseudoconfigurations is also proved. While the LP 
receiver is generally more complex than the corresponding SP 
receiver, the LP receiver and its associated pseudoconfiguration 
structure provide an analytic tool for the analysis of SP receivers. 
As an example application, we show how the LP design technique 
may be applied to the problem of joint equalization and decoding. 

I. Introduction 

The decoding algorithms for the best known classes of 
error-correcting code to date, namely concatenated ("turbo") 
codes [fl and low-density parity check (LDPC) codes lO, 
have been shown to be instances of a much more general 
algorithm called the sum-product (SP) algorithm [3], H, Q. 
This algorithm solves the general problem of marginalizing 
a product of functions which take values in a semiring TZ. 
In the communications context, TZ is equal to K and the 
maximization of each marginal function minimizes the error 
rate on a symbol-by-symbol basis. It was also shown that many 
diverse situations may allow the use of SP based reception ||6l, 
including joint iterative equalization and decoding (or turbo 
equalization) \1\ and joint source-channel decoding lH. 

Recently, a linear-programming (LP) based approach to 
decoding linear (and especially LDPC) codes was developed 
for binary jg), ifTol and nonbinary coding frameworks ifTTIl . 
lfT2l . The concept of pseudocodeword proved important in 
the performance analysis of both LP and SP based decoders 
ifTJl . lfT4l . |15|. Also, linear-programming decoders for ir- 
regular repeat-accumulate (IRA) codes and turbo codes were 
described in |16|. Regarding applications beyond coding, an 
LP-based method for low-complexity joint equalization and 
decoding of LDPC coded transmissions over the magnetic 
recording channel was proposed in [17]. 

In this paper it is shown that the problem of maximizing 
a product of 7^-valued functions is amenable to an approxi- 
mate (suboptimal) solution using an LP relaxation, under two 
conditions: first, that the semiring TZ is equal to a subset of 
R, and second, that all non-pendant factor nodes are indicator 
functions for a local behaviour. Fortunately, these conditions 



are satisfied by almost all practical communication receiver 
design problems. Interestingly, the LP exhibits a "separation 
effect" in the sense that pendant factor nodes in the factor 
graph contribute the cost function, and non-pendant nodes 
determine the LP constraint set. This distinction is somewhat 
analagous to the case of SP-based reception where pendant 
factor nodes contribute initial messages exactly once, and 
all other nodes update their messages periodically. Our LP 
receiver generalizes the LP decoders of ifTOl . lfT2l . lfT6! |. It is 
proved that both the SP and LP based receivers are inhibited 
by the same phenomenon which we characterize as a set of 
pseudoconfigurations; this is not intuitively obvious since the 
SP receiver derives from an attempt to minimize error rate on 
a symbol-by-symbol basis, while the LP receiver derives from 
an attempt to minimize the configuration error rate. 

II. Maximization of a Product of Functions by 
Linear Programming 

We begin by introducing some definitions and notation. 
Suppose that we have variables Xi, i e X, where X is a finite 
set, and the variable a;,; lies in the finite set Ai for each i E T. 
Let X = {xi)ii=i\ then x is called a configuration, and the 
Cartesian product A = Iliei-^i i^ called the configuration 
space. Suppose now that we wish to find that configuration 
X E A which maximizes the product of real-valued functions 






(1) 



where J' is a finite set, Xj — {xi)ii=x- and Ij C I for each 
j G J. We define the optimum configuration ajopt to be that 
configuration x E A which maximizes ([T]i. The function u{x) 
is called the global function 1,5J. 

The factor graph for the global function u{x) and its 
factorization ([TJ is a (bipartite) graph defined as follows. There 
is a variable node for each variable Xi (i G T) and a factor 
node for each factor fj (j £ J'). An edge connects variable 
node Xi to factor node fj if and only if Xi is an argument of 
fj. Note that for any j G J^, Xj is the set of i e I for which 
Xi is an argument of fj. Also, for any i E T, the set of j G ^7 
for which Xi is an argument of fj is denoted jTi. The degree 
of a node v, denoted d{v), is the number of nodes to which it 
is joined by an edge. Any node v for which d{v) = 1 is said 
to be pendant. 

Define 

y = {iel : 3jG Ji with d{f,) = l} 



i-C-, y ^ 2r is the set of i El for which variable node Xi is 
connected to a pendant factor node. Then, for i G 3^, define 

hi {xi) = Y\ fj (^») • 

We assume that the function hi (xi) is positive-valued for each 
i E y. Also, denoting the Cartesian product Ay = Ylnzy Ai, 
we define the projection 

Py : A > Ay such that Py (x) = {Xi)i^y . 

Also, we adopt the notation xy = (xi)i^y for elements of 
Ay. 

Next define C ^ {j e J : d{fj) > 2}. So, without loss 
of generality we may write 



Building on these mappings, we also define 



- (a;) = n '^i (^») • n -f^ (^j 



(2) 



Now, assume that all factor nodes fj, j G C, are indicator 
functions for some local behaviour Bj, i.e., 

fj (xj) = [xj G B,] Vj G C 

where the indicator function for the logical predicate P is 
defined by 

r , f 1 if P is true 
[0 otherwise. 

Note that we write any v E Bj as v ^ {vi)iei-, i.e., v is 
indexed by Ij. Also we define the global behaviour B as 
follows: for any a; G A we have a; G ,8 if and only if Xj E Bj 
for every j E C. The configuration a; G ^ is said to be valid 
if and only if x E B. 

We assume that the mapping Py is injective on B, i.e., 
if a;i,a;2 G B and Py{xi) = Py{x2), then Xi = X2- 
This corresponds to a 'well-posed' problem. Note that in the 
communications context, since all non-pendant factor nodes 
are indicator functions, observations may only be contributed 
through the set of pendant factor nodes. Therefore, failure of 
the injectivity property in the communications context would 
mean that one particular set of channel inputs could correspond 
to two different transmit information sets, which would reflect 
badly on system design. 

So we have 



a^opt = argmax TT /li (aJi) ■ TT fj {xj 
\iey jec 

= arg max TT hi (xi) 

iey 
= argmax > log hi (xi) . 



iey 



Denote Ni = \Ai\ for i E I, and Ny = J2i(,y Ni. Now, for 
each i E 2, define the mapping 



by 






H : A 



{0,1} 



A^v 



C 



bA^v 



according to 



'-{xy) = {^^{x^))^ey 



We note that H is injective. 

Now, for vectors g E M.^^ , we adopt the notation 

9 = {gt)tey where g^ == (,9-"-')aeA Vi G 3^ . 
In particular, we define the vector A G M^^ by setting 

X^^^ log hda) 

for each i E y, a E Ai- This allows us to develop the 
formulation of the optimum configuration as 



Xopt = argmaxy^log/ii (, 



xeB 



iey 



arg max y^ Ai g^ (xj ) '^ 



xeB 

iey 

— argmax AH(7'j;(a;))"^ . 
xeB 

Note that the optimization has reduced to the maximization of 

an inner product of vectors, where the first vector derives only 

from observations (or "channel information") and the second 

vector derives only from the global behaviour (the set of valid 

configurations). This problem may then be recast as a linear 

program 

a^opt = Py' (3"'(9opt)) (3) 

where 

9opt = arg max \g^ (4) 

geK.y(B) 

and the maximization is over the convex hull of all points 
corresponding to valid configurations: 



JCy{B) = i7co„v{H {Py (x)) : xeB} 



(5) 



III. Equivalent Linear Programming Solution for 
THE Optimum Configuration 

In this section we define a lower-complexity LP to solve 
for the optimum configuration, and prove that its performance 
is equivalent to the original. Here, for each i E T, let a, be 
an arbitrary element of Ai, and let A^ = Ai\{ai} (note that 
for each i E I, \Ai\ > 2, otherwise Xi is not a 'variable'). 
Denote N[' — \ A^ \ > 1 for every i E I, and denote Ny — 
'^i^y N^ . Then, for each i El, define the mapping 



y\i 



{0,1} 



n: 



c 



i>n: 



by 



Building on this, we also define 

^ : Ay^ {0, 1}^^ C : 

according to 

'^{xy) = {h{xi)\ey 



t,N-. 



We note that H is injective. 



Now, for vectors g e W v , we adopt the notation 



9 = i9,)tey where g, = (.g,|"^) 



aeAf 



Viey 



In particular, we define the vector A G 



1>NZ 



by setting 



~t^ = log 



hi{a) 



_hi{ai)_ 
for each « G 3^, a e A^l . Our new LP is then given by 



X 



opt 



PyH'^ \9opt) 



where 



9opt = arg max Xg 

geKy{B) 



xT 



(6) 



(7) 



and the maximization is over the convex hull of all points 
corresponding to valid configurations: 



ICy{B)^H,onAS{Py{x)) : X E B} 



(8) 



The following proposition proves the equivalence of the 
original and lower-complexity linear programs. 

Proposition 3.1: The linear program defined by (|6])-(l8]l 
produces the same (optimum) configuration output as the 
Unear program defined by ([3]l-(|5]l. 

Proof: It is easy to show that the simple bijection 



defined by 
where 

Vi ey,ae At 



W : ICy{B) ^ ICy{B) 
W{g) = g 



(a) 

9i = 



~{a) 

91 

1 - y^ 5^*^^ 



if a G Ai 
if a = a, 



which has inverse given by 



ct = <^ V^G3;,aG^: 



has the property that g — 'a{Vy{x)) if and only if g = 
W{g) = a{Vy{x)). Also observe that if g = W{g), 



Ag 



xT 



^ [log hi (a) - log hi (a,)] 5^"^ 
■eA- 

^ log/i,(a)5,^"' - log/i,(ai)[l - 5i"' 



a£A 



aeA 



Xg - log h,{at) 



(9) 



i.e. the bijection W preserves the cost function up to an 
additive constant. Taken together, these two facts imply that 
g maximizes Xg over ICy{B) if and only if g = W{g) 
maximizes Xg^ over ICy{B). This proves the result, and 
justifies the use of the notation aiopt in Q. ■ 



IV. Efficient Linear Programming Relaxation and 
ITS Properties 

To reduce complexity of the LP, we introduce auxiliary 
variables whose constraints, along with those of the elements 
of g G R^y , will form the relaxed LP problem. We denote 
these auxiliary variables by 

Pj^b for each j G £, 6 G Bj (10) 

and we form the following vector 

For each i G T\y, let ti be an arbitrary element of J^. The 
constraints of the relaxed LP problem are then 



Vj G £, V5 G Bj, pjM > , 
Vj e C, ^ pj^b = 1 , 

beBj 



Vi G y, yj G j; n £, Va G A- 

9i — l^bGBj, bi=aP3,b 



(11) 
(12) 

(13) 



and 



Vi G I\y, Vj G JMU}, Va G A^, 

l^beBj. bi=aPj,f> — l^beBti: bi=aPii,b ■ (14) 

Constraints (fTTli-(fT4ll form a polytope which we denote by 
Q. The maximization of the objective function Xg over Q 
forms the relaxed LP problem. 

Observe that the further constraints 



Vjg£, VbG6„ p,,b<l, (15) 

Vi G 3^, Va G Ar , < gf ^ < 1 (16) 

V* e 3^, Y, ~9^^ < 1 (17) 

aeAJ' 



and 



follow from the constraints (fTTI)-(fT4l). for any {g,p) G Q. 

The receiver algorithm works as follows. First, we say 
a point in a polytope is integral if and only if all of its 
coordinates are integers. If the LP solution (g^^^jp) is an 
integral point in Q, the output is the configuration ajout = 
Py^ ( H (gout) ) (we shall prove in the next section that this 
output is indeed in B). This configuration may be equal to the 
optimum configuration (we call this 'correct reception') or it 
may not be (we call this 'incorrect reception'). Of course, in 
the communications context, we are usually only interested in 
a subset of the configuration symbols, namely the information 
bits. If the LP solution is not integral, the receiver reports 
a 'receiver failure'. Note that in this paper, we say that the 
receiver makes a reception error when the receiver output is 
not equal to the correct configuration (this could correspond 
to a 'receiver failure', or to an 'incorrect reception'). 



V. LP Equivalent to the Efficient Relaxation 

We next define another linear program, and prove that 
its performance is equivalent to that defined in Section |IV] 
This new program is more computationally complex than that 
defined previously, but (due to its equivalence and simplicity 
of description) is more useful for theoretical work. For this 
we define N = J2i£x ^i ^i^^ 



dNZ 



i£X - 



{o,irc 



pAf 



according to 

S(a;) = {t,{x,))iex . 

Again, H is injective. For vectors g G M^, we denote g — 
{9i)iGi and g = {g,)tey, where g, = (5i"'')ae^. for each 

i el. 

The new LP optimizes the cost function Xg^ over the 
polytope Q defined with respect to variables g and p, the 
constraints ( fTTI ) and ( fT2] i. and the following single constraint: 

bei3j, bi=a 

Note that ( fTSl l, together with the constraints 



VieX, VaGA, 0<gf^<l 



(19) 



and 



Vz e z, ^ 5I"' = 1 (20) 

follow from the constraints ( fTTI ). ( fT2b and ( fTSl l. for any 

(9,p)eQ. 

In this case, the receiver output is equal to the configuration 
Xout =3 (9out) in the case where the LP solution (Sout^P) 
is an integral point in Q (again, this output is in B), and reports 
a 'receiver failure' if the LP solution is not integral. 

The following theorem ensures the equivalence of the two 
linear programs, and also assures the optimum certificate 
property, i.e., if the receiver output is a configuration, then 
it is the optimum configuration. 

Theorem 5.1: The linear program defined by ( fTTT i. ( fT2] i 
and ( fTsT i produces the same output (configuration or receiver 
failure) as the linear program defined by (fTni-(fT4ll. Also, in 
the case of configuration output, if the receiver output is a 
configuration, then it is the optimum configuration, i.e., cCout = 

Proof: It is straightforward to show that the mapping 







V : Q 


— — > 


Q 






i9,P) 


i — > 


{a,p) 


defined by 


( 


^ 




ifiey.ae A] 


9t' - < 


1 


- 2lf3eA-^ 


-^' 


\f i £ y , a — a. 




i E, 


beBt^^bi^c 


^PU,b 


if i e i\y 


and with inverse 









#)=gi") Vze3;,aeA 



is a bijection from one polytope to the other (i.e. g G 
satisfies (fTTI)-(fT4li for some vector p if and only if g G M^ 
with {g,p) = V{g,p) satisfies ([TT]i, ([T2]i and ^^ for the 
same vector p). Also, since (g,p) ~ V{g,p) implies g = 
^{q)^ ® implies that the bijection V preserves the cost 
function up to an additive constant. 

Next, we prove that for every configuration x G B, there 
exists p such that (H {x) ,p) E Q. Let x G B, and define 



yjeC,beBj, pjM = 



if b = {xijieXj 
otherwise. 



Letting g = a{Vy{x)) and g — H(a;), it is easy to check that 
{g,p) e Qand(g,p) e Q (and that in fact (g,p) = V{g,p)). 
This property ensures that every valid configuration x G B has 
a "representative" in the polytope, and thus is a candidate for 
being output by the receiver 

Next, let {g,p) £ Q and let g £ R^ be such that (g,p) = 
V{g,p) G Q. Suppose that all of the coordinates of p are 
integers. Then, by (fTTT i and (fTSl l. for any j G C we must have 

1 if b = b^'^ 



V6 £ Bj, pj^b 



otherwise 



for some b^-'' S S, 



Now we note that for any i G 2, j,k <E J'iCi C, if b. 



U) _ 



then (using (ITsT l) 

9t'= E 



Pj,b 



E 



beBj, bi=a 



1 = > Pk.b 

belSk, bi=a 



(21) 



lU) _ 



and thus bl ' = a. Therefore, there exists x £ A such that 

Therefore, a; is a valid configuration {x E B). Also we may 
conclude from (I2TI ) that 



9 



(") 



1 if Xi — a 
otherwise 



and therefore g — H(a;). Also, from the definition of the 
mapping V , we have g — a {Py (x)). 

Summarizing these results, we conclude that {g^p^ ,p) E Q 
optimizes the cost function \g^ over Q and is integral if and 
only if (Sopt-P) = ^"^(Sopt.P) G Q optimizes the cost 
function Xg over Q and is integral, where H (g) = x E B 
andxy^S {g)^Vy{x). ■ 

Thus both LP receivers output either a receiver failure, or 
the optimum configuration, and have the same performance. 
The LP receiver of Section |IV| has lower complexity and is 
suitable for implementation (e.g. for the program of Section 
I Vill i: however, for theoretical work the LP of Section |V] is 
more suitable (we shall use this polytope throughout Section 

iyb. 

VI. PSEUDOCONFIGURATIONS 

In this section, we prove a connection between the failure 
of the LP and SP receivers based on pseudoconfiguration 
concepts. 



A. Linear Programming Pseudoconfigurations 

Definition 6.1: A linear-programming pseudoconfigura- 
tion (LP pseudoconfiguration) is a point (g,p) in the poly tope 
Q with rational coordinates. 

Note that, since the coefficients of the LP are rational, 
the LP output must be the LP pseudoconfiguration which 
minimizes the cost function. 

B. Factor Graph Covers and Graph-Cover Pseudoconfigura- 
tions 

We next define what is meant by a finite cover of a factor 
graph. 

Definition 6.2: Let M be a positive integer, and let S = 
{1,2,-- , M}. Let Q be the factor graph corresponding to the 
global function u and its factorization given in ([T]i. A cover 
configuration of degree M is a vector a;'^^) = (x- )igi 
where x[^^^ = {x^^i)ies e Af^ for each i e I. Define u^*^) 
as the following function of the cover configuration a;^*^^ of 
degree AI: 



,(M) 



(a.(^^)) = n n /^ K') (22) 



lesjej 



where, for each j ^ J, i G Tj, IIj ,; is a permutation on the 
set S, and for each j G J, I G S, 

Xj,l = {XiMj,iil))i&Ij ■ 

A cover of the factor graph Q, of degree M, is a factor graph 
for the global function u'*^' and its factorisation ( |22] |. In order 
to distinguish between different factor node labels, we write 
(|22] | as 

where fjj — fj for each j G J, I G S. 

It may be seen that a cover graph of degree M is a graph whose 
vertex set consists of M copies of xi (labelled a;^ ;) and M 
copies of fj (labelled fj.i), such that for each j £ J, i E Ij, 
the M copies of Xi and the M copies of fj are connected in 
a one-to-one fashion determined by the permutations {IIj i}. 

We define the cover behaviour Bm as follows. The cover 
configuration a;'^^) lies in Bm if and only if Xj_i G Bj for 
each j e J, I e S. 

For any M > 1, a graph-cover pseudoconfiguration is a 
valid cover configuration (i.e. one which lies in the behaviour 

Bm). 

For any graph-cover pseudoconfiguration, we also define the 
graph-cover pseudoconfiguration vector h G M^ according to 



{o')^ 



h = {hi)i(=i where hi = {hl')aeA, Vi G X 



and 



,(") _ 



= \{l e S : Xi^i = a]\ 



for each i G I, a G Ai. Finally, we define the normalized 
graph-cover pseudoconfiguration vector g G M^ by 9 = 

h/M. 



C. Equivalence between Pseudoconfiguration Concepts 

In this section, we show the equivalence between the set 
of LP pseudoconfigurations and the set of graph-cover pseu- 
doconfigurations. The result is summarized in the following 
theorem. 

Theorem 6.1: There exists an LP pseudoconfiguration 
(g,p) if and only if there exists a graph-cover pseudocon- 
figuration with normalized pseudoconfiguration vector g. 

Proof: Suppose x^^^'^ is a graph-cover pseudoconfigura- 
tion for some cover of degree M of the factor graph, and g is 
its normalized graph-cover pseudoconfiguration vector Then, 



9. 



(a) 



1 



|{/ G 5 : x^^i = a}\ 



for alH G I, a G Ai. Next define p according to 

Pj,b = J^\i^^^ '■ ^hi = ''ll 

for all j e C, b e Bj. Then it is easily seen that (dB, <0 
and ( fTsT i are satisfied, and so (g,p) G Q. 

To prove the other direction, suppose {g,p) G Q. Denote by 
M the lowest common denominator of the (rational) variables 
Pj,b for j G C, b E Bj. Define Zj^b = ^^Pj,b for j G C, 
b G Bj; these must all be nonnegative integers. Also define 
h^' — Mgy^' for all i G I, a G Au these must all be 
nonnegative integers by ( fTSl l. 

We now construct a cover graph of degree M as follows. 
Begin with M copies of vertex Xi (labelled xii) and M copies 
of vertex fj (labelled /,,;), for i G T, j G J. Then proceed 
as follows: 

« Label nf copies of Xi with the value a, for each i G I, 
a G Ai. By ( |20] |. all copies of Xi are labelled. 

• Label Zji, copies of fj with the value 6, for every j G C, 
b G Bj. By ( fT2] l. all copies of /, are labelled. 

> Next, let T^' denote the set of copies of Xi labelled 
with the value a, for i G I, a E Ai. Also, for all j G C, 
i £ Xj, a £ Ai, let R\" denote the set of copies of fj 
whose label b satisfies bi — a. The vertices in T^°'' and 
the vertices in Rl"' are then connected by edges in an 
arbitrary one-to-one fashion, for every j E C, i £ Ij, 
a G A,. 
Numerically, this connection is always possible because 



IT, 



(")i 



= h^-' = 



E 



Z],b 



= \R 



(")i 



beCj, bi=a 



for every j G C, i G Tj, a G Ai. Here we have 
used ( fTSl ). Finally, for each i E y and j E Ji satisfying 
d{f j) = 1, the M copies of xi are connected to the M 
copies of fj in an arbitrary one-to-one fashion. It is easy 
to check that the resulting graph is a cover graph for 
the original factorization. Therefore, this vertex labelling 
yields a graph-cover pseudoconfiguration. 



VII. Example Application: LP-Based Joint 
Equalization and Decoding 

In this section we consider an example application where we 
use the above framework to design an LP receiver for a system 
using binary coding and binary phase-shift keying (BPSK) 
modulation over a frequency selective channel (with memory 
L) with additive white Gaussian noise (AWGN). Information- 
bearing data are encoded to form codewords of the binary 
code 

C^{ceGF{2Y' : cH'^^O} 

where 7i is the code's m x n parity-check matrix over GF{2). 
Denote the set of code bit indices and parity-check indices 
by W = {1,2,- ■ ■ ,n} and V = {1,2,--- , m} respectively. 
We factor the indicator function for the code into factors 
corresponding to each local parity check: for j G V, define 
the single-parity-check code over GF{2) by 



C] — {{ci)i^Uj 



ieUj 



0} 



where Uj C W is the support of the j-th row of H for each j e 
V, and the summation is over GF{2). Thus c G C if and only if 
{ci)ieu- G Cj for each j e V. The BPSK modulation mapping 
M, which maps from GF{2) to K, is given by A^(0) = 1 and 
M{\-) = —1. The channel has L + 1 taps {/iq, /ii, • • • , ft-i} 
and the received signal for the communication model may be 
written as 



L 

E 

t=0 



htM{ct-t) +ni 



where rii is a zero-mean complex Gaussian random variable 
with variance a^. 

We adopt a state-space (trellis) representation for the chan- 
nel, with state space S = GF{2)^\ also let S^ = 5\{0}. The 
local behaviour (or trellis edge set) for the state-space model, 
denoted P, is assumed to be time-invariant, although extension 
to the case of time-variant channel is straightforward. For 
simplicity we assume that the initial and final states of the 
channel are not known at the receiver For d ^ V, let ip(rf), 
op(d), s^{d) and s^{d) denote the channel input, output, start 
state and end state respectively. Thus if we set V = Gi^(2)^+^ 
and adopt the notation d = {do di ■ ■ ■ ^l) £ 2?, we 
may have ip(d) = do, s^{d) — [di d2 ■■■ di,), s^{d) = 
{do di ■■■ di-i), and op(d) = ^t^ohtM{dt). Also let 
V- = V\{0}. 

The structure of the LP may be written as follows (we use 
the efficient LP defined in Section llVb . The variables of the 
LP are 

5,1''^ for each ieU,deV~ , 

Wj,b for each j E V,b E Cj , 

qi,d for each i G U,d E T> , 



'On a correct reception, the LP variables {w, ;,} and {q^ ^} serve as 
indicator functions for the single-parity-check codewords and the channel 
outputs respectively. 



and the LP constraints are (here U = U\{n}) 

'^j eV.'^beCj, wj-b>0 (23) 

and 

Vi G W, Vd e P, qtd > (24) 

which follow from ( fTTT l. 



beCi 



and 



from (O, 



yieU, ^ qi,ci = 1 



dev 



VieU,deV-, gf^^qr^d 



(26) 



(27) 



from dTsl l. and 



l^deV, ip(d)=0 ^Ud — l^beCj, b,=0 '^j-b (^8) 



and 



J2deV, s'!'{d)=s li.d — z2d£V, sS{d) = s qi+l,d (29) 

from ( fT4l l. 

Also, the LP cost function is 



E E >^9^' 



(30) 



where we have, for i ElA, d E T>^ , 



)^^ = log^'^^^^l'^) 



p{n\o) 

= Jj(|r, -op(0)|'-|r, -op(d)l') . (31) 

Note that in this application, the variables g- ', together 
with the constraint ( |27l ), would be removed due to their 
redundancy, and the variables g^ ^ used directly in the cost 
function (l30b . The resulting LP is capable of joint equalization 
and decoding, and has strong links (via Theorems 15.11 and 16.11 ) 
to the corresponding "turbo equalizer" based on application 
of the sum-product algorithm to the same factorization of the 
global function. 
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